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Abstract 

We present a regularization method to approach a solution of the pessimistic for- 
mulation of ill -posed bilevel problems . This allows to overcome the difficulty arising 
from the non uniqueness of the lower level problems solutions and responses. We 
prove existence of approximated solutions, give convergence result using Hoffman-like 
assumptions. We end with objective value error estimates. 



ning, network design, and so on... This large class of important and strategic economic 
problems can be viewed as static noncooperative asymmetric games. Two players seek 



1 Introduction 

^f) ' Bilevel programming problems are of growing interest both from theoretical and practical 

[ points of view. These models are used in various applications, such as economic plan- 

o ' 

g ■ to optimize their individual objective functions. The first player (the leader) must take 

^ ' into account the reaction (or any possible reaction when non unique) of the second player 

^ I (the follower). Such a problem can be ill posed since the lower level ( follower's problem ) 

may have many solutions and responses for every (or some) fixed leader's variables. In the 
so-called "optimistic case ", many optimal reactions of the follower are possible and the 
follower is assumed to choose in favor of the leader. In this case, the upper level problem 
can be modelled using a bilevel formulation. These programs are quite difficult noncon- 
vex optimization problems. Several theoretical results and heuristics or approximation 
techniques can be found in the recent literature [Hi El El HI El E| • In some of these 
works, strong assumptions are made to simplify the model. The solution of the lower level 
is supposed to be unique or if they are many, they provide the same (unique) upper level 
objective value. 

The lower level is replaced by the equivalent first order optimality conditions and can 
be viewed as an equilibrium problem. Most of time, the complementarity part of these 
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optimality conditions is smoothed or penalized using different tecfiniques. 
In our approach we consider the reahstic situation where different reactions of the follower 
are possible. There are multiple responses and we consider the so-called "pessimistic" 
formulation of the asymmetric game. This can be interpreted as a kind of non-cooperative 
asymmetric game 

Throughout this paper, we shall consider the general bi-level problem: 



/ and h are smooth functions from R" x to M. Moreover, for every y E K, f{y, •) 
and h{y, ■) are convex and / takes only positive values ( assumptions will be made more 
precise later). 

Remark 1.1 Since the upper-level objective function f has to be maximized, one can 
suppose it (without loss of generality) to be positive. Indeed, f can be replaced by 
(max{/ - f{yo,xo),0}f for some yo £ K and xq G S{yo) ■ 

As mentionned before, the main difficulty comes from the fact that the cost "function" 
f{y,x) , X G S{y) can be a multivalued application whenever the lower level set is 
not unique and distinct solutions yield distinct upper-level objective function values. In 
addition, it is not clear that f{y,x) = f(y,x) for any x,x & S(y). Therefore, it is difficult 
to compute the solutions (if there are any). 

The remaining of the paper is organized as follows. We introduce the regularization 
method and give an existence result in next section. Section 3 is devoted to an asymptotic 
analysis: we prove that the cluster points of solutions to the penalized problems are 
solutions of a three-level limit problem corresponding to the " pessimistic" formulation of 
the considered ill-posed bilevel problems . We give some error estimates in the last section. 

2 The penalized problem 

We would like to let the upper level objective function single valued. So we are going to 
use a penalization process that allow to compute approximate solutions more easily. More 
precisely, e > being given, we consider the following penalized problem 




where K and C are non empty convex, closed, bounded subsets of M" and 



S{y) = argmin { h{y, z) \z E C } 



(1.1) 




max/(y,x) 
yeK, xe Se{y) 
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where 



Seiy) = aigmin {he{y,z) \z eC }, 



(2.1) 



where 



he{y) = h{y,z) + ef{y,z) . 



(2.2) 



For each nonnegative e, the bi-level problem (Ve) is well posed . Furthermore, under some 
general and non restrictive assumptions on / and h we will prove that the upper level 
function is single valued and continuous with respect to the leader variables y. 

This regularization technique makes some selection property on the solutions of the 
lower level problem which is easy to characterize and have an explicit and simple economic 
interpretation. In almost all other regularization methods, the lower level is replaced by 
its optimality conditions. The bi-level problem is then considered as a mathematical 
program with equilibrium constraints. The "hard" part of these constraints ( namely the 
complementarity conditions ) is then smoothed or penalized. In fact these methods make 
also some selection ( the generated sequences converge to the analytic center when using 
smoothing methods or the least norm center ) on the solution set of the lower level but 
these selections do not have any economic interpretation since they have no link to the 
objective function of the upper level. Moreover, convergence results need more restrictive 
assumptions. 

For convenience of the reader, we first give or recall some direct and classical results. 
These results will be useful for forthcoming developpements. 

Lemma 2.1 For any e > 0, the lower-level problem 



admits (at least) a solution so that Se{y) 7^ 0. Moreover, there exists a constant G M 
such that 



Proof - The existence of a solution to Qe.y is obvious since C is bounded and /, h are 
continuous. Moreover Q^^y may be written as follows 




Vx e Se{y) 



f{y, x) = Ky . 



min h{y, z) + et 




f{y,z)-t = 0, 
zeC , 

v 
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Since / takes only positive values, the equality constraint can be obviously replaced by an 
inequality in this minimization problem 



g* 



min h{y, z) + et^ 
f{y,z)-t<0, 



Q*^y is a convex problem and the cost function is strictly convex with respect to t. 

This simple observation proves that the optimal value of t is unique and completes the 

proof. □ 

Lemma 2.2 Let be e > fixed. The niulti- application is lower semi- continuous in the 
following sense : if Uk ^ U oind G Se{yk) then x^ ^ x £ Ss{y) (up to a subsequence). 

Proof - Let be Xk £ Ss{yk) C C. As C is bounded, then (xk) is bounded as well and 
converges to some x (up to a subsequence). As x^ £ Ss{yk) we get 

Vz G C h{yk,Xk) + ef^{yk,Xk) < h{yk, z) + ef'^{yk, z) . 
As / and h are continuous with respect to y and x we obtain 

Vz G C h{y, x) + ef\y, x) < h{y, z) + ef\y, z) , 
that is X G Se{y). □ 
Lemma 2.3 Let be e > fixed. The cost function 

Ve-y^ {f{y,x) I X G Se{y)} 
is single-valued and continuous. 

Proof - We see that the function Vs is single valued, with Lemma l2. II Let us prove the 
continuity: let be (yk) a sequence that converges to some y. Then Ve{yk) = fivk-, Xk) where 
Xk G Ss{yk)- Lemma |T21 yields that Xk converges (up to a subsequence) to x G Ss{y)- As 
/ is continuous with respect to y and x we get 

Veivk) = f{yk,Xk) f{y,x) = Ve{y) . 

□ 

We may now give an existence result : 

Theorem 2.1 For any e > 0, problem (Ve) admits at least an optimal solution y^. 
Proof - As Ve is continuous and K is bounded, the result follows. □ 
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3 Asymptotic results 

3.1 A convergence result for the solutions of (Ve) 

In this subsection, we study the behaviour of solutions of (V^) as e goes to 0. First, we 
introduce some notations: 

S{y) = argmin{/2(y, z) \z G S{y) }, (3.1) 
where S{y) is given by and 

, ~^ I max f(y, x) 

iV) (3.2) 

[ y£K , x£ S{y) , 

Note that problem (V) is a three-level problem that can be written in an extended way 
as follows: 



max/(y,x) 
yeK 

X G argmin {/^(y, z) \z £ argmin { h{y, w) \w C }^ , 



{V) < 

Lemma 3.1 x G S{y) is equivalent to 



X G S{y) and \/z £ C such that h{y, z) = h{y, x), f {y, z) > f {y, x) . 

Proof - Assume that z satisfies h{y, z) = h{y, x) with x G argmin { h{y, t) \ t G C }. Then 
z G argmin { h{y, t) | t G C }. □ 

Lemma 3.2 Let y be fixed. If Xf, G converges to some x, then x G S{y) 

Proof - Assume Xe G Se and 0. For every z G C we get 

h{y, Xe) + e/^(y, Xe) < h{y, z) + e/^(y, z) . 

When e ^ 0, as the functions are continuous we obtain 

\/z £ C h{y,x) < h{y,z) , 

that is X £ S{y). 

Let be X G C such that h{y,x) = h{y,x). Then 

h{y,Xe) + ef'^{y,Xe) < h{y, x) + ef'^{y, x) since x G C 

< h{y, x) + ef'^{y, x) since h{y , x) = h{y , x) 

< h{y,Xe) +e/^(y,x) since Xg G C and x G S{y) . 
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Therefore 

Vx G C such that h{y,x) = h{y,x), f'^{y,Xe) < f'^{y,x) . 
Passing to the hmit with the continuity of / gives 

Vx G C such that h{y,x) = h{y,x), f'^{y,x) < p{y^x) . 

With Lemma l3. II we conclude that x £ S{y). □ 
To estabhsh the main convergence result of this work, we will use some technical but 
not so very restrictive assumption. 
Let us set 

= h{ye,Xe) + o{e) , (3.3) 

and 

Ke = {x eC\h{ye,x) <ae] . (3.4) 
Assume we can find o"o > and £0 > such that 

Ve < £0 inf \yxh{y£,x)\>ao, (3.5) 

This assumption does not seem quite natural at a first glimpse. In fact it a Hoffman- 
inequality type assumption which is more or less standard in this context. The proof of 
next theorem, and especially the proof of Lemma [3. 31 below will make this hypothesis clear. 

Theorem 3.1 Assume condition \3. 5\) is verified and let y^ an optimal solution to (Vg). 
Then converges to some y (up to a subsequence) and y is an optimal solution to iV). 

Proof - Let y^ an optimal solution to ("P^). Then y^ £ K which is bounded. So (extracting 
a subsequence) we may assert that ys converges to y. As is closed then y G K. As y^ 
is an optimal solution to (Vs) we have 

\/y £ K ,\/xe £ Se{y) f{y£,Xe)>f{y,Xe) (3.6) 

where Xg G ^^(ye). Note that x^ £ '5e(y) implies that Xg G C. So Xg is bounded and 
converges to x (up to a subsequence) with x G S{y) f Lemma 13. 2j) . 
Passing to the limit in (|3.6|) gives 

\/y e K ,3x e S{y) such that f{y, x) > f{y, x) , 

where x is the limit (of a subsequence) of Xg. Now we need the following result to achieve 
the proof : 
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Lemma 3.3 Assume that iS. 5\) is satisfied and let (ye,Xe G Se{ye)) converging to {y,x). 
Then x G 

Thanks to the definition of S{y) we note that /(y, •) is constant on S{y), namely 

Vz G S{y) f{y,z) = f{y,x) . 

Finally 

\/y e K, \/x e S{y) f{y,x)>f{y,x), 

with X £ S{y). This means that y is an optimal solution to (V). 
• It remains to prove Lemma EIHl 

Let ye converging to y and Xg G Ss{ye)- As G C (bounded) one may extract a 
subsequence converging to x. We are going to prove that x G S{y). 

We first prove that x G S{y). As x^ G ^^(yg) we have 

VzgC h{ye,xe) + ef{ye,x,)<h{y„z) + efiye,z); (3.7) 
as / and g are continuous, passing to the limit gives 

yz £ C h{y,x) < h{y,z) , 

that is X £ S{y). 

Let X G S{y). Suppose for a while that 3e such that 

Ve < e X G Ae . (3.8) 

We get 

h{ye,x) < h{ye,Xe) +o(e) ; 

with relation ()3.7I) this gives 

VzgC %e,i)+£/'(ye,Xe) </i(2/e,2)+£/'(ye,^) + o(e) . (3.9) 
As X G C relation (|3.7|) yields as well 

h{ye,Xe) + ef{ye,Xe) < h{ye,x) + ef{ye,x) . 
Adding these two relations gives 
VzGC h{ye,xe) + 2e p{y,,xe) <h{y„z) + e p{y,,z) + e p{ye,x) + o{e) ; (3.10) 
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the choice of z = imphes 

e fivs, Xe) < e f{ye,x) + o(e) , 

that is 

f\y,,Xe)<f\ye,x)+°-^. 

Passing to the hmit gives finahy 

VxG5(y) f{y,x)<f{y,i). 

This means that x G S{y). 

Unfortunately, there is no reason for "assumption " H3.8|) to be satisfied and we must 
get rid of it. We are going to adapt the previous proof (we gave the main ideas). If i ^ 
then we perform a projection: we call Xg the projection of x on Ag. We are going to show 
that converges to x. 

As X ^ Ae we get < h{y^^x) . Let us call aa^{h) the following real number 

<yaAh) = mf 17 7-^; , (3.11) 

where d{x,A^) is the distance between x and A^ and 

[as < h{ye, •)] = { X E M" I ag < h{ye,x)} . 

This so called Hoffman constant can be defined following for instance Aze and Corvellec 
0. Therefore 

h{ye,x) -ae> d{x, A^) a^, {h) . 
As d{x,A!r) = d{x^Xe) we obtain 

d{x,Xs)< ■ 

aa, (n) 

We have to estimate (Ta^{h). In particular we look for Uo > such that 

Vs Ga^ {h) > ao . 

In PI, it is shown that 

<7a^(/i) > inf \Va:h{ye,x)\ , 

h{ys:,x)=as: 

where \'Vxh{ye,x)\ stands for the strong slope of h at {ye,x) with respect to x ([2]); the 
strong-slope of a function ip at x is defined as 



\Vip{x)\ := <^ 



if x is a local minimum of ip , 

T ^(x) — v>(y) 1 

lim sup r — otherwise 

y^x d{x,y) 
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Using (|.S.5j) . we have 

~ ^ ^ Hye,x) - ae ^ h{ys,x) - h{ye,Xe) + o(g) ^ Q 

Indeed ?/e ^ y, ^ x, h is continuous and h{y,x) = h{y,x). 

We may now end the proof. We can use relation p.lOf) with instead of x so that 

Vz G C h{ye,xe) + 2ef{ye,xe) < h{ye, z) + e f{ye, z) + e f{ye, Xe) + o{e) ; 
we choose z = Xs once again to get 

fiy„Xe)<f\y,,Xe) + ^. 

Passing to the hmit as e ^ gives (for every x £ S{y) 

f\y,x)<f\y,x). 

This means that x £ S{y). □ 

Remark 3.1 It is clear that assumption 5|) is satisfied if h is linear ("linear" case). 
Next problem is to find simple conditions for (y, x) to get 5(1 when h is not linear. One 
hint is to assume that h is and that ||Va;/i(t/, a;|| ^ 0; then the strong slope | Va;/i(ye, x)| 
coincides with the norm xh{ye, x)\\ of the gradient of h with respect to x. With the 
convergence of {ye,Xs) to {y,x) (up to a subsequence), there exist Eq and r] > such that 

Ve<eo \\Vxh{ye,Xe)\\ >ri > ; 

next we have to prove that \\^xh{ye,x)\\ > r] for any x such that h{y^,x) = a^. A good 
tool could be an "local inversion theorem" for the multivalued case but it is not obvious. 
The problem is still open. We have the same challenge in next section. 

3.2 Comparison of (V) and (V) 

Now, it is clear that a solution of the penalized problem (Ve) is a good approximation of 
a solution of (V). Anyway, it is not a solution (a priori) of the problem in consideration 
(V). So we have to compare (V) and (V). 

The second level of (V) clearly disappears when the initial problem lower level solutions 
set corresponds to the same revenue for each value of y (or are unique). In this case (V) 
and (V) are equivalent. In other cases, the solution of (V) corresponds to some "optimal 
worst" case solution. 

This solution is still important for the decision makers of the upper level problem. 
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Remark 3.2 Using the same regularization technique, if we replace ef^{y, z) by —sf'^{y, z) 
in the definition of hf,, we will obtain (at the limit) an optimal solution of (V) which cor- 
responds to an optimal best case solution of our asymmetric game . 

4 Error estimates 

The purpose of this section is to study the behavior of /(y*, x*) — /(y^, x^) as e ^ and 
provide (if possible) some error estimates. Since the penahzed problems are nonconvex, 
we can not use any classical perturbation result. We proceed in two steps : we first prove 
some monotonicity results for the upper level objective function values and then consider 
classical perturbation analysis results for some auxilliary convex problems. 

4.1 Preliminary results 

Lemma 4.1 Let be e > e' > and y e K. Let be Xg G and x G Ss'{y). Then we get 

f^{y,xe)<f\y,x) . 

Proof - Let us fix e > > and choose some y ^ K. Let be G S^iy) and x G S^i^y). 
Assume that 

f\y,x) < f\y,x,) . (4.1) 
As X G Sei{y) and Xg G C, we have 

h{y, x) + e'f'^iy, x) < h{y, Xe) + e'f'^{y, x^) , 

h{y, x) + e'f\y, i) + {e - e')f\y, x) < h{y, x,) + e'f\y, x,) + (e - e')f\y, x) 
With (|^rT|) and e > e' > 0, we obtain 

h{y, x) + e/^(y, x) < h{y, Xe) + e7^(y, x^) + (e - e')f'^{y, Xe) <= h{y, Xe) + ef^{y, x^) 
So 

h{y, x) + e/^(y, x) < min { /i(y, x) + e/^(y, x), x G C} 
and we get a contradiction. □ 

Lemma 4.2 Let be e > e' > and ys (respectively ye') a solution to (Vs) (respectively 
i(Pe'))- Let be Xe G Se{ye) and x^i G Ssi{y^i). Then 

f\ys,xe)<f\ye',x,,)<f\y*,x*) , 

where y* is a solution to (P) with x* G S{y*). 
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Proof - Using Lemma liTD with y = Ue and G Se{ye) gives 

Vx E /2(y.,x,) < f{ye,S:) . (4.2) 

As y^i is a solution of {Ve') we get 

Vy e -fC, Vx G Se'{y) fiye',Xe') > f{y,x) . 
We may choose in particular y = y^ and x = x G Se'{ye) to get 

Vx G cS^/d/e) /(?/£', Xg/) > /(ye,x) . (4.3) 
As / is assumed to be nonnegative we finally obtain 

f{ye,Xe) < f{y£,x) < f{ye',Xs') ■ 

Therefore the family [f{yir,Xe) is increasing). The convergence of /(7/e,Xe) to f{y*,x*) (/ 
is continuous) achieves the proof since f{y*,x*) is the limit and the upper bound of the 
family {f{ye,Xe)) . □ 

Lemma 4.3 Let be e > and x^ G S^{y*) where y* is a solution to iV). Then 

Vx, G Se{ye) f{y*,x,) < f{ye,xe) < f{y\x*) . (4.4) 

Proof - This is a direct consequence of Lemma 14.21 : the relation f{y£,Xe) < f{y*,x*) is 
obvious and the relation f{y*,x^) < f(y^,Xs) comes from the fact that is a solution to 

CPs). □ 

Remark 4.1 The previous lemmas show that it is sufficient to study f{y*,x*) — f{y*,X£) 
for some x, G Ss{y*)- 

For a large class of realistic problems, the lower level is linearly constrained, moreover, 
we use for our analysis some local error bounds and these bounds are very complicated in 
case of nonlinear constraints. So, we assume from now on that C is polyhedral : 

C = { X G M" I Ax = b, x>0} , 

where A is a m x n real matrix and b G M™. 

In the sequel y* is a solution to (V) (which existence is given by Theorem 3.1) and 
X* G S{y*) ( see (jSU) so that 

X* G argmin { f'^{y*,z) \ z G argmin {h{y*,C) ,C G C} } . 
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Let us denote 

a* = h{y*,x*) and /3* = f{y*,x*) . (4.5) 

Note that /3* is the optimal value for (V) (the upper level) so that we may assume that 
P* ^ (otherwise the problem is trivial). We set 

C* = {xeC I h{y*,x) < a* and f{y*,x) </?*}. (4.6) 

Let us give an important property of C* : 

Proposition 4.1 Assume y* is a solution to (V) and C* is defined with (|-<^.6p , then 
C* = {x(EC I hiy*,x) = a* and f{y*,x) = /3* } 

and 

C* = {x£C I h{y*,x)+f{y*,x)<a*~a* + (3*}. 

Proof - Note that it impossible to get h{y*,x) < a*, if x G C*. Indeed, as x* G 5(y*) 
then X* £ S{y*) = argmin {h{y*X) ,C ^ C} . Therefore : 

VCgC %*,x*)<%*,C). (4.7) 

Setting C = X £ C* gives 

a* = h{y*,x*) < h{y*,x) < a* . 

So 

VxgC* h{y*,x)=a*. 
The same remark holds for /?* so that 

C* = {xeC I h{y*,x) = a* and f{y*,x) =/?*}. (4.8) 

Let us call 

C' = {xGC I h{y*,x) + fiy\x)<a* } . 

It is obvious that C* C C. Conversely, let be x G C". Relation (|4.7|1 yields a* < h{y*,x) 
so that 

a* + f{y\x)<a* +P* . 

This gives f{y*,x) < /?*. Similarly, we get h{y*,x) < a* and x G C*. □ 
The main point is now to estimate (roughly speaking) the distance between the solution x* 
and 5e(7/*). As x* G C* and C* is defined with inequalities, we first assume a Hoffman-type 
condition. 
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4.2 Error estimates under an Hoffman hypothesis 

Following Aze and Corvellec ^ we know that 

f{y*,x) + h{y*,x)-a* 



inf \V.,{f{y*,.)+h{y*,-))\< ^ inf 



W*<f{r,-)+Hy*,-)] ' ' xe[a*<f{y*,-)+h{y*,-)] d{x, [f{y*, •) + h{y* , •) < a*] 

The notation [cr* < f{y*, •) + •)] stands for the set 

{xGM" I a* <fiy*,x)+h{y*,x) } . 

We note that [f{y*, •) + •) < o"*] = C*. In this subsection, we assume the following 

m 1*:=^ ^inf |V, (/(y*, •)+%*,•)) I >0. 

Let us call 7 = — : assumption (Hi) implies that 

Ve > 0, Vx, G cS,(y*) 3xleC*s.t. - < 7 [/(y*, x,) + i,) - a* - /?*] • 

(4.9) 

Note also that relation (|4.4|) of Lemma 14.31 yields that 

yxeeSeiy*) f{y*,xe)<p* 

and 

h{y\xe) < a* +£(3* 
because of the definition of Therefore 

and 

Ve > 0, Vie e Se{y*) 3x* e C* s.t. \\ie - < 75 . (4.10) 

The existence of such Lipschitzian error bound for convex or general inequalities is, itself, 
an interesting domain of research. It is strongly related to metric regularity properties. A 
large number of conditions and characterizations can be found in [21 El 13 El 1131 1151 116j . 
This list of references constitutes a small but significant part of the existent literature. 

Remark 4.2 1. Assumption (TCi) is fulfilled if the functions f and h are linear with 
respect to x. Indeed they cannot be identically equal to and the strong slope coincides 
with the norm of gradient which is a positive constant. 
2. X* is the projection of x^ on C* . 
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Lemma 4.4 Both Xs G Se{y*) and x* given by i4.1C\ ) converge to x* E <S{y*) as e — > 0. 

~ * 

X — X 

Proof - We know that x* (with the previous results). Let us set = . As 

de is bounded (by 7) it clear that x* and x^ have the same limit point (namely x*). □ 
In what follows Xs is an element of Ss{y*) and x* is the associated element given by 

Km . 

Let us define 

I{x*) ={ie {l,---,n} I < = } , and C = { d G M" | Ad = , d\i(^,^ > } . 
Let d be in C. 

Then, there exists > such that \/e < Eq-, x* + ed £ C . Indeed 

• A{x* + ed) = A{x*) + eAd = A{xl) = b . 

• If i e I{x*), then {x* + ed)i > x^^ > 0. 

• If i ^ I{x*), then x* > 0. As x* — > x*, 3ei such that x* ^ > forah e < Then we 
choose ri = inf {ejj so that 

\/e <r] x*^j > . 

Now choosing < r/ small enough we get (x* + ed)i > for any e < Eq- 

As Xs G <Se{y*) and x* + G C we have 

/i(y*,5,)+e/2(y*,x,) < /i(y*,x* + ed) + e/2(y*,x*+e(i) , 

/i(y*, X,) - h{y*,xl + ed)+e [/^(y*, x,) - f\y*,xt + ed)] < . 
As the functions are C^, we have 

h{y*^Xe) = h{y*,xl) + V^/i(y*,x*) • (x^ - x*) + (x^ - x*)o(xe - x*) 

h{y\xe) = h{y\xl) + eV^h{y\xl)-de + edeo{ede) , (4.11) 

and 

h{y*,x* + ed) = h{y*,x*) + eV^h{y*,xl)-d + edo{ed) , (4.12) 
where Vxh stands for the derivative of h with respect to x. As x* G C* and Xs €z C then 

%*,x:) = Q* = %*,a;*)<%*,x,) . 
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With relation (|4.11|) this gives 

VMy\<) -de + de 0{ede) = ^^^^^ ~ "^^^ > . 

As de is bounded (by 7), there exist cluster points; passing to the limit gives 

VMy\x*) ■ d= lim V,%*,x:) -4 > , (4.13) 

for any cluster point d of the family d^. 

In addition, we obtain with H4.11() and H4.12() 

eV^h{y\xl)-de+edeo{ede)-eV^h{y*,xiyd-edo{£d)+e [f{y\ie) - f{y*,x*+ed)] < 

that is 

V^h{y*,xl)-{d,-d) + deo{eds)-do{ed) + [f{y*,i,)-f{y*,xl+ed)] <0 . 

Passing to the limit (with Lemma |4.4|) we obtain 

VMy*,x*)-{d-d)<0 , (4.14) 

where d is a cluster point of the sequence de and any d £ C. As d = belongs to (7, we 
get 

Finally, we obtain with ()4.13|) 

vMy*,x*) ■ d = lim v,h{y*,^*e) ■ = o . (4.15) 

This means that 

Vxh{y*,x*) ■ {xs - X*) = o{e). 

As 

Ky*^Xe) = h{y*,x*) - V^h{y*,xl) ■ (x* - x^) + (x* - x^) o{x* - 

we get 

h{y\^e) - h{y*,x*) = o{e) - ede o{ede) = o{e) . 
As X* G C* then h{y*,x*) = a* and 

yxeGSeiy*) h{y\xe) = h{y*,x*) + o{s) . (4.16) 

As h and play similar roles we have the same result for More precisely 

Vi,G5,(y*) f\y*,Xs)-f\y*,xn = o{e) . (4.17) 
We just proved the following result 
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Theorem 4.1 Assume that (TLi) is satisfied ; let he a solution to (Ve) and Xe G Ss{y*). 
Then 

h{y*,Xe) - h{y*^x*) = o{e) and f{y*,Xe) - f{y*,x*) = o{e) as e ^ . 
Moreover 

yxe e Se{ye) f{y*,x*) - fiye,Xe) = o(e) as e ^ . 

Proof - The first assertion has been proved : relations (|4.16() and 1)4.17^ . We use relation 
(|4.4|) and the previous result to claim that 

f\y*,x*)-f{ye,Xe) = o{e) . 

As f{y*,x*)-f{y„xe) = [f{y*,x*) + f{y,,Xe)][f{y*,x*)-f{ye,Xe)] and f{y*,x*) + 
f{ye,Xe) —>■ 2f{y*,x*) = 2(3* we get the result since P* ^ 0. □ 
With a bootstrapping technique we obtain the following corollary ; 

Corollary 4.1 Under the assumptions and notations of the previous theorem, we get 

VXe e Se{ye) 

VnGN = o(e") 

and Vxe G •Seiy*) 

h{y\xe)-h{y\x*) = o{e^) . 

Proof - Using relations (|4.16|) and H4.17() in assumption (TCi) we see that relation ()4.1U() 
becomes 

Ve > 0, G Se{y*) 3x* G C* s.t. \\xe - x*|| < 70(e) . (4.18) 

Using the same technique leads to relations (|4.16|) and 1)4. 17|) with e^ instead of e and so 
on. □ 

Remark 4.3 These error estimates are still valid (with the same proofs ) when the pe- 
nalized problems are approximatively solved. 

4.3 Error estimates under a "second-order" assumption 

If assumption {Tii) is not ensured, one may, however, give estimates using the following 
hypothesis 




3eo > , 3(5 > 0, such that Vx G C* + ^(0, e^) 
3xeC* such that ||x - if < 5 [{h{y* , x) - a*)^ + {f {y* , x) - p*)^] 
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Remark 4.4 {'H2) means that C* is H-metrically regular (of the second order). (See the 
definition of this regularity property for example in ^j| Def. 4-3- 2). {'H2) also corresponds 
to a quadratic growth condition ^ Def. 3.1 . 

This assumption is significantly weaker than ((Hi) and covers a large class of problems 
since it is satisfied when h{y*, .) + f{y*, .) is linear or quadratic. 

We have a rather similar result which proof is the the same as in the previous subsection 
(so that we do not detail it) : 

Theorem 4.2 Assume that {(H2) is satisfied ; let ye he a solution to (Ve) and Xe G Se{ye)- 
Then 

f{y*,x*) - f{ye,Xs) = o{^/e) as e ^0 , so that 
Vr>0 fiy*,x*)-f{ye,Xe) = o{e'--). 
Moreover, Vx^ G <Ss{y*) 

Vr>0 h{y*,Xe)-hiy*,x*) = o{e^~^) . 

5 Conclusion 

With this new penalization approach, the pessimistic formulation of general bi-level prob- 
lems becomes, in some way, tractable. Indeed, instead of the complicated limit problem, 
we only need to solve approximately the penalized one for a small value of the parameter 
£. We have given error estimates that prove that this approximation is reasonable even 
when Hoffman's assumption is not satisfied . 
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